Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Object detection method based on radar and camera fusion
Jie GAO, Yuan ZHU, Ke LU
Journal of Computer Applications    2021, 41 (11): 3242-3250.   DOI: 10.11772/j.issn.1001-9081.2021020327
Abstract363)   HTML10)    PDF (1594KB)(489)       Save

In the automatic driving perception system, multi-sensor fusion is usually used to improve the reliability of the perception results. Aiming at the task of object detection in fusion perception system, a object detection method based on radar and camera fusion, namely Priori and Radar Region Proposal Network (PRRPN), was proposed,with the aim of using radar measurement and the object detection result of the previous frame to improve the generation of region proposals in the image detection network and improve the object detection performance. Firstly, the objects detected in the previous frame with the radar points in the current frame were associated to pre-classify the radar points. Then, the pre-classified radar points were projected into the image, and the corresponding prior region proposals and radar region proposals were obtained according to the distance of the radar and Radar Cross Section (RCS) information. Finally, the regression and classification of the object bounding boxes were performed according to the region proposals. In addition, PRRPN and Region Proposal Network (RPN) were fused to carry out object detection. The newly released nuScenes dataset was adopted to test and evaluate the three detection methods. Experimental results show that, compared with RPN, the proposed PRRPN can not only detect objects faster, but also increase the average detection accuracy of small objects by 2.09 percentage points. And compared with the methods by using PRRPN and RPN alone, the method by fusing the proposed PRRPN and RPN has the average detection accuracy increased by 2.54 percentage points and 0.34 percentage points respectively.

Table and Figures | Reference | Related Articles | Metrics